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DETAILED ACTION 

Continued Examination Under 37 CFR 1. 1 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.1 14. Applicant's submission filed on 27 July, 
2011 has been entered. 

Response to Amendment 

2. The amendment filed on 27 July 201 1 has been entered. Claims 1 , 4, 19, 20, 22- 
25, 27, 28, 30-33, 40, 45, 48, 55-57, 55-57 and 59-66 have been amended. Claims 9, 
21, 26, 42 and 58 have been cancelled. Claims 1, 4-7, 10, 12-16, 19, 20, 22-25, 27-33, 
36, 40, 43-45, 48-53 and 55-57 and 59-66 are now pending. 

Response to Arguments 

3. Applicants' arguments with respect to claims 1 , 33, 40 and 66 have been 
considered but are moot in view of the new ground(s) of rejection. 



Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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5. Claims 1 , 4-7, 1 0, 1 2-1 6, 1 9, 20, 22-25, 27-31 , 33, 36, 40, 43-45, 48-53, 55-57 
and 59-66 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Zwaneveld (CA 2129925) in view of Hale (US 6,785,539) and further in view of 
Lange et al (US 2001/0025241 - referred hereinafter as "Lange"). 

Regarding claim 1 , Zwaneveld teaches a captioning system for providing 
captions for a presentation to a user, the captioning system comprising: 
a caption store (storage element 1 1 ) configured to store one or more sets of captions 
each set being associated with one or more presentations and each set comprising a 
plurality of captions for playout at different timings during the associated presentation 
(page 9, line 1 8 - page 1 0, line 21 ; for display cue stamps comprises a display time 
stamp, each display time stamp comprising a first time and second time respectively 
marking the beginning and the end of the display of a subtitle). 

Hale teaches: 

a portable user device (portable device 14) having: 

a first receiver configured to receive, from said caption store, at least one set of captions 
for storage in the user device or to receive a sequence of captions for a presentation to 
be made to a user associated with the user device (col. 2, line 63 - col. 3, Iine3; col. 3, 
lines 1 7-21 - for the portable user device receives caption texts and stores them); 
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a caption output circuit configured to output each received caption to the user 
associated with the user device; and a timing controller to determine the timing during 
the presentation at which each caption should be output based on the synchronization 
information determined by a synchronizer (col. 3, lines 34-40) and configured to control 
said caption output circuit so that said each caption is output to said user at the 
determined timing (col. 4, line 61 - col. 5, Iine15; col. 5, lines 17-31 - it is noted that a 
timing controller exists in the user device for the subtitles to be synced to the proper 
presentation and displayed at the appropriate time denoted by the display time codes). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the user device of Zwaneveld to be a "portable" device to 
work in tandem with the caption storage, as taught by Hale, for the benefit of combating 
the problems presented by "open captioning" and presenting captioning conveniently to 
a user (Hale, col. 1 , lines 35-41 ; col. 2, lines 1-4). 

Lange teaches a presentation including a wireless acoustic signal; a cellular telephone 
having a microphone configured to receive the wireless acoustic signal of the 
presentation and to generate a corresponding electrical signal; a synchronizer 
configured to process the electrical signal obtained from the microphone corresponding 
to said acoustic signal of said presentation, to determine synchronization information for 
use in defining the timing during the presentation at which each caption is to be output 
to the user associated with the cellular telephone (Fig. 1 , microphone; f [17], [18] and 
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[25] - [29]; microphone receives acoustic audio and the cellular telephone uses it to 
garner captions or text of the acoustic signals or voice that it just received). 
Therefore, it would have been obvious to an ordinary skilled artisan at the time the 
invention was made to modify the user device of Zwaneveld and portable device of Hale 
by making it a cellular phone (useful for synchronizing acoustic signals with a stored text 
data and outputting the text to the user), as taught by Lange, for the benefit of allowing 
a hearing impaired individual readily enjoy the benefits of a portable telecommunication 
devices and communicate better, especially in a "public" forum. 

Regarding claim 4, Hale further teaches the system according to claim 1 , wherein 
said captions include text and wherein said caption output is configured to output said 
captions to a display device associated with the cellular telephone for display to the user 
(col. 3, lines 34-40; col. 5, lines 17-31; for closed captions include text and captions are 
displayed on the screen display of the portable device 14). 

Regarding claim 5, Hale further teaches the system according to claim 4, wherein 
said captions include formatting information for controlling the format of the text 
displayed on said display {for the subtitles have certain formats which can be altered. It 
is noted that displayable texts are encoded with "formatting information" or instructions 
on how and where to appear on a display screen). 

Regarding claim 6, Zwaneveld further teaches the system according to claim 4, 
wherein each caption includes duration information defining the duration that the caption 
should be displayed to the user (page 1 1 , lines 1 -6; for the display cue stamp comprises 
display time stamp which denotes when the subtitles are to be shown. The display time 
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stamp further denotes a beginning and the end of the display of a subtitle - reading on 
claimed duration of caption display). 

Regarding 7, Zwaneveld further teaches the system according to claim 4, 
wherein said caption includes timing information defining the time at which the caption 
should be displayed to the user during the presentation (page 1 1 , lines 1 -6; for display 
time cues include display time marks denoting the timing information - beginning and 
end- of the subtitles). 

Regarding claim 10, Zwaneveld further teaches the system according to claim 1 , 
wherein said presentation includes audio (page 25, lines 6-1 0+; page 30, lines 6-13. 
See also Hale, col. 3, lines 34-40, 48-55 - for teaching on audio presentations). 

Regarding claim 12, the combined teachings of Zwaneveld, Hale and Lange 
further teaches the system according to claim 1 , wherein said caption store is formed in 
a memory card which is insertable into said user device and wherein said user device 
includes a reader for reading captions from said memory card when inserted therein 
(see Zwaneveld, page 1 7, lines 6-12; page 29, lines 11-17; for the subtitle text files are 
stored in a memory medium - RAM, CD-Rom, floppy disk - which are portable; the 
caption storage element 1 1 can be embodied in a portable memory medium and sent to 
the user device - processing equipment- which would read/process it and send it to a 
display element. See also Hale, for teaching on storing of captions in the portable 
device and on memory cards - col. 2, line 63 - col. 3, line 3). 

Regarding claims 13-15, note the discussion on claim 12. Hale further teaches 
the system according to claim 1 , wherein said caption store is provided in a computer 
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system and wherein said cellular telephone includes a communication module for 
communicating with said computer system; wherein said computer system is remote 
from said cellular telephone; and wherein said cellular telephone includes a housing and 
wherein said communication module is provided within said housing (col. 2, line 63 - 
col. 3, line 1 7; for it is noted that a docking station is used for connecting the portable 
device to a computer system; the docking station also may be used to connect the 
portable device to remote content sources. It is also well known that a mobile phone or 
PDA includes a housing and it is obvious that a communication module is housed inside 
to enable communication with a docking station). 

Regarding claims 16, Hale further teaches the system according to claim 13, 
wherein said communication module is configured to communicate with said remote 
computer system using a wireless communication link (col. 3, lines 12-16). 

Regarding claim 19, the combined teachings of Zwaneveld, Hale and Lange 
further teach the system according to claim 42, wherein said synchronization 
information defines expected time points for one or more predetermined portions of the 
presentation (for the display time cues and time stamp indicates points denoting the 
portions of the presentation to output subtitle information. See also Hale for teaching on 
synchronization code associated with a beginning portion of a presentation). 

Regarding claim 20, the combined teachings of Zwaneveld, Hale and Lange 
further teach the system according to claim 1 , wherein said receiver is configured to 
receive synchronization data associated with the set of captions, the synchronization 
data identifying expected time points of one or more predetermined acoustic portions of 



Application/Control Number: 1 0/500,01 6 Page 8 

Art Unit: 2425 

the presentation and wherein said synchronizer comprises a monitoring circuit operable 
to monitor said electrical signal obtained from the microphone to identify the actual time 
points of said one or more predetermined acoustic portions of the presentation and 
wherein said synchronization information generated by said synchronizer comprises a 
difference between the actual time points identified by the monitoring circuit and the 
expected time points identified by said synchronization data (see Hale, col. 3, lines 23- 
25, col. 5, lines 17-52; synchronization time codes for synchronization an audio signal 
with captions; for the display time stamps and cue identify the expected timing to output 
the caption information; the responsiveness of said timing controller to the difference 
between the actual timing and the expected timing is merely a form of error correction of 
synchronization signals. OFFICIAL NOTICE is hereby taken to the fact that error 
correction is well known concept in the art. Therefore, it would have been obvious to 
one of ordinary skill in the art at the time the invention was made to have made the 
timing controller responsive to the difference between the actual and expected times, as 
an element of error correction to ensure the correct captions are being outputted). 

Regarding claim 22, Zwaneveld further teaches the system according to claim 
20, wherein said synchronization data associated with the set of captions includes a 
signature for each of said one or more predetermined acoustic portions of the 
presentation, wherein said monitoring circuit is configured to process said electrical 
signal from the microphone and to generate a signature for a current portion of the 
presentation, wherein the synchronizer further comprises a comparator that is 
configured to compare the signature generated by the monitoring circuit with a signature 
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of said synchronization data and wherein the cellular telephone has: (a) an acquisition 
mode of operation in which the signature generated by the monitoring circuit is 
compared with each of said signatures of said synchronization data to identify a current 
position within said presentation and (b) a tracking mode of operation in which the 
signature generated by said monitoring circuit is compared with an expected one of 
signatures of said synchronization data (see Zawaneveld, page 30, lines 13-22; for the 
output of the monitoring circuit is merely the time the user requests sets course to 
request for a subtitle, which is compared to the syncing display time stamp. Hence, the 
acquisition and tracking modes of operation are merely met by the comparison of audio 
signal signatures and associated subtitles reputedly each time the user requests subtitle 
information by 'collecting' an audio sample of the desired portion and sending it to the 
processor element 14). 

Regarding claim 23, see the discussion on claim 22. 

Regarding claim 24, the combined teachings of Zwaneveld, Hale and Lange 
further teach the system according to claim 20, wherein said cellular telephone is 
configured to receive said synchronization data from said caption store (Fig. 3; page 12, 
line 25 - page 1 3, line 3; page 1 7, lines 6-12; for the sync info or time cue stamps 
together with the subtitle info are stored in the storage device 1 1, which forwards them 
to the processor equipment 14 or Hale's portable user device 14 or Lange's processing 
system 20). 

Regarding claim 25, the combined teachings of Zwaneveld, Hale and Lange 
further teach the system according to claim 1, wherein said synchronization information 
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is embedded within said acoustic part of the presentation (see Zwaneveld, page 12, line 
25 - page 13, line 3; page 30, lines 10-25; Hale, col. 3, lines 23-25, col. 5, lines 17-52). 

Regarding claim 27, Zwaneveld further teaches the system according to claim 
25, wherein said synchronization information comprises synchronization codes 
occurring at different timings during the presentation (page 12, line 25 - page 13, line 3; 
for synchronization codes are inherently embedded in the audio of the presentation to 
produce the synchronization information. See also Hale, col. 3, lines 23-25, col. 5, lines 
17-52). 

Regarding claim 28, Zwaneveld further teaches the system according to claim 
27, wherein each synchronization code is unique to uniquely define the position in the 
presentation {for different or multiple display timings, it is noted that the synchronization 
information would also be different accordingly). 

Regarding claim 29, Zwaneveld teaches the system according to claim 1, 
wherein said caption store includes a plurality of sets of captions for a plurality of 
different presentations {for it is noted that the system provides subtitle information for 
different movies and films). 

Regarding claim 30, the combined teachings of Zwaneveld, Hale and Lange 
further teach the system according to claim 29, wherein said cellular telephone is 
configured to process the electrical signal from the microphone corresponding to the 
acoustic part of the presentation to determine data for use in identifying the presentation 
therefrom (Lange, Fig. 1 , microphone; f [17], [18] and [25] - [29]) and is configured to 
transmit the determined data to said caption store and when said caption store is 
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configured to use said determined data to identify the presentation being made and to 
transmit the associated set of captions for the identified presentation to said first 
receiver (page 30, lines 4-26; for it is also obvious to modify the user device of Hale to 
capture a part presentation and decipher the presentation being made and output the 
captions already stored in the user device - col. 5, lines 24-28). 

Regarding claim 31 , note the discussion on claim 30. The combined teachings 
of Zwaneveld, Hale and Lange further teach the system according to claim 30, wherein 
said determined data comprises data characteristic of a captured portion of the acoustic 
part of the presentation and is configured to transmit said characteristic data to said 
caption store, and wherein said caption store is configured to use said characteristic 
data to identify the presentation being made and to transmit the associated set of 
captions for the identified presentation to the user device (see Zwaneveld, page 30, 
lines 4-26; for the extracted characteristic data is audio signature of the captured portion 
of the presentation; see also, Hale in col. 3, lines 23-25, col. 5, lines 17-52). 

Claim 33 is analyzed as the portable user device discussed in claim 1 . 

Regarding claim 36, the combined teachings of Zwaneveld, Hale and Lange 
further teach a computer readable medium storing computer executable instructions for 
causing a general purpose computing device to operate as the cellular telephone of 
claim 1 (Zwaneveld, page 30, lines 10-13; See also Hale, col. 2, lines 46-47 - memory 
and processors). 

Regarding claim 40, see claim 1 . 
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Regarding claim 43, Lange further teaches a system according to claim 1 , 
wherein the first receiver is configured to receive a set of captions or said sequence of 
captions via a telephone network (col. 6, lines 24-38). 

Regarding claim 44, Hale further teaches a system according to claim 1 , wherein 
said first receiver is configured to receive said set of captions or said sequence of 
captions over a wired communications link in advance of the presentation (col. 3, lines 
4-7, 17-21). 

Regarding claim 45, Hale further teaches a system according to claim 1 , wherein 
said cellular telephone is configured to use said first receiver to download a next caption 
from said caption store when it detects a synchronization code in the electrical signal 
received from said microphone (of Lange) that corresponds to the acoustic part of the 
presentation (col. 3, lines 22-33 - for use in downloading the caption content from a 
remote server by the portable device only when they are needed and thereby 
requested). 

Regarding claim 48, note the discussion on claim 43. Hale further teaches a 
system according to claim 1 , wherein said caption store is provided by a remote server 
(col. 3, lines 10-16). 

Claim 49 is analyzed as a device of claims 4 and 5. 

Claims 50 and 51 are analyzed as devices of claims 6 and 7 respectively. 

Claim 52 is analyzed as a device of claims 1 3 and 1 4. 

Claim 53 is analyzed as a device of claim 16. 

Claim 55 is analyzed as a device of claim 42. 
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Claims 56, 57, 59 and 60 are analyzed as devices of claims 19, 20, 22 and 23 
respectively. 

Claim 61 is analyzed as a device of claim 25. 

Claims 62-65 are analyzed as devices of claims 27, 28, 30 and 31 respectively. 
Claim 66 is analyzed as a method of claim 1 . 

6. Claim 32 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Zwaneveld in view of Hale in view of Lange and further in view of Ogasawara (US 
6,512,919). 

Regarding claim 32, the combined teachings of Zwaneveld, Hale and Lange 
teach the system according to claim 1 , wherein said presentation is given at a venue 
(for a movie or film theatre is a venue. Further, venue broadly reads on any location). 

However, they do not explicitly teach wherein said venue is configured to provide an 
activation code, wherein said user device is operable to receive said activation code 
and further comprises an inhibitor for inhibiting the operation of said caption output 
unless said cellular telephone has received said activation code. 

Ogasawara teaches a venue configured to provide an activation code, wherein said 
cellular telephone is configured to receive said activation code (col. 3, lines 6-17; col. 9, 
lines 6-14; 33-42; for the purchase transaction program is downloaded from the server 
to the mobile telephone, thereby reading on an activation code, because without the 
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transaction program the videophone cannot function as a personal electronic shopping 
system) and further comprises a inhibitor for inhibiting the operation of said caption 
output circuit unless said cellular telephone has received said activation code (for 
without the purchase transaction program being sent to it, the phone can't function as a 
shopping system; hence it is obvious that the phone has an 'inhibitor' or access denial 
mechanism). 

Therefore, it would have been obvious to an ordinary skilled artisan to modify the 
portable cellular telephone to include an access mechanism by receiving a program or 
access code to access the caption store, as taught by Ogasawara, for the benefit of 
ensuring a privacy and proper identification of the user. 



Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 

8. Beadles et al (US 5,648,789); see f [Abstract]. 

9. Applebaum (US 6,463,41 3). 

10. Handlos (US 5,475,798); see Figs. 1 and 2; fl [Abstract]; col. 2, lines 17-56. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dika C. Okeke whose telephone number is (571)270- 
5367. The examiner can normally be reached on Monday - Thursday, 9:00 a.m. to 7:00 
p.m., EST. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Brian T. Pendleton can be reached on (571)272-7527. The fax phone 
number for the organization where this application or proceeding is assigned is 571 - 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Dika C. Okeke/ 
Examiner, Art Unit 2425 

/Brian T Pendleton/ 

Supervisory Patent Examiner, Art Unit 2425 



